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ABSTRACT 

The 

proposed seven-year 
what they read — and 
text — are described 
description of the 



heuristic model and measurement models guiding a 
investigation of how children learn to comprehend 
in particular how they comprehend science 
in this report. The report first offers a brief 
heuristic model, which is based upon and extended 



from studies of effective teaching and includes eight constructs: (1) 
the abilities possessed by students entering school; (2) 
instructional materials; (3) classroom management; (4) instructional 
feedback; (5) instruction in decoding, comprehension, and science; 
(6) stable home characteristics; (7) home support for literacy and 
science knowledge; and (8) student ability at the end of 
kindergarten. The remainder of the report discusses and presents 
empirical support for the measurement models built for each of the 
constructs. References, figures and a table of effective behaviors 
four stages of instruction are appended. (FL) 
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Abstract 

How do children learn to comprehend what they read? And, how do 
children learn to comprehend science text? These are the primary 
questions driving a longitudinal study in progress since 1983, 
requested by NIE and funded by the Center for the Study of 
Reading and the National Science Foundation, This report sets 
forth the heuristic model and measurement models guiding this 
proposed seven-year investigation to follow two cohorts of 
children from kindergarten through fifth grade • The constructs 
that compose this model are: entering student ability; 
instructional materials characteristics; classroom management; 
instructional feedback; instruction in decoding, comprehension, 
and science; stable heme characteristics; home support for 
literacy and science knowledge; and student ability at a second 
time. This heuristic model is intended to guide each year's data 
collection. 
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The Heuristic and Measurement Models During a Study 
of Reading Comprehension Development and Science Knowledge 

How do children learn to comprehend what they read? And 
particularly, how do children learn to comprehend science text? 
To answer these questions we first built a heuristic model based 
upon and extended from studies of effective teaching. This model 
includes: work focused on changes in student achievement 
correlated with instructional practices such as classroom 
management; instructional feedback; decoding and comprehension 
instruction; materials coverage and characteristics; and home 
support for literacy and science knowledge. That model appears 
below. 



Insert Figure 1 about here. 



We selected these constructs for measurement because of the 
convergence of findings in the last decade that points to 
positive correlations for these variables and student outcomes in 
basic skills. From this heuristic model we next built 
measurement models for each construct- We hypothesize materials 
to be outside teachers' control in the sense that individual 
teachers seldom select their materials, but once materials are 
purchased, school administrators usually expect them to be used. 
Also, although teachers may add to or subtract from their 
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materials, they generally use them (Durkin, 1978-79, 1981). We 
further hypothesize that teachers 1 classroom management and 
feedback will affect decoding, reading comprehension, and science 
instruction. In addition, we expect stable, specific home support 
for literacy and science to influence student performance. 

The next section of this paper presents the measurement 
models for determining what students knew when entering school 
that predicted later performance, materials 1 characteristics, 
classroom practices that mediate entering ability, and home 
support for literacy and science knowledge. 

Student Ability 
Findings From Longitudinal Studies of Reading 

Little longitudinal research has focused on reading, and the 
few studies that have been done have addressed questions such as 
can children be taught to read in kindergarten, or do children 
who read early have any long-term advantage in reading 
comprehension over children who learn to read later? We have, 
however, identified seven longitudinal studies of beginning 
readers. These studies are briefly described below. 

A few studies have followed children through several grades. 
Durkin (1966) reported on two groups of students. She began her 
study in 1958 by testing large groups of incoming first graders. 
She identified 49 early readers in one school district and 157 
children in a second district. Durkin f s central question was 
whether children who could read when they began school would 
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maintain their advantage through the elementary grades. Durkin 
followed her first group through fifth grade and her .acond group 
through third grade. The results of this work showed significant 
lasting achievement differences for children who could read 
before beginning school. 

McKee, Brzeinski, and Harrison (1966) reported their 
findings the same year that Durkin published hers. They randomly 
assigned 4,000 entering kindergarten children from the Denver 
Public Schools to experimental and control conditions. Children 
in the experimental group were taught to read in kindergarten. 
Children in the control group had traditional kindergarten 
experiences. Further variation in experimental and control 
conditions continued beyond kindergarten. Children from the 
kindergarten experimental and control conditions were again 
randomly assigned to accelerated or regular first grade 
instruction. 

McKee, Brzeinski, and Harrison followed their subjects 
through fifth grade. The findings from this investigation were: 
Children who received kindergarten reading and continued 
accelerated programs outperformed first-grade starting 
accelerated groups, kindergarten reading children who shifted to 
regular instruction in first grade, and children who did not 
receive kindergarten reading. 

Durkin (1966) was exclusively interested in children who 
could read before starting school. McKee, Brzeinski, and 
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Harrison studied the long-term effects of reading instruction 
thac began in kindergarten and was accelerated through fifth 
grade. Beck (1973) conducted a study from 1967-1972 which 
focused on selecting children for reading instruction in 
kindergarten and comparing those children f s reading ability to a 
matched sample. Over five years, Beck used 4 predictors to 
select kindergarten children for reading instruction. These 
predictors were: children's knowledge of letter names, teacher 
judgment, reading readiness scores, and the children's perceptual 
abilities. During her study, Beck found that each year teachers 
selected larger numbers of students for reading instruction. 
Like McKee, Brzeinski, and Harrison, Beck was primarily 
interested in finding out if children in first through fifth 
grades who received reading instruction in kindergarten achieved 
better in reading than children who bad not been taught to read 
in kindergarten. She found statistically significant differences 
favoring kindergarten readers at each of five grade levels. Beck 
stated: 

The combination of no significant difference results of the 
tests for homogeneity of regression and the 'significant 
difference 1 results of the analysis of variance is very 
important, as it suggests that kindergarten reading 
instruction positively affects subsequent reading 
instruction, no matter what the I.Q. (p. 59) 
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Further support for long-term differences in children f s 
reading achievement after kindergarten reading instruction comes 
from work with experimental and control groups by Durkin (1970; 
1974-1975). These two studies grew from Durkin f s earlier 
research (1966) with children who could read early. Durkin 
developed a program for four-year-old children, and she followed 
those children for six years. Durkin f s (1974-1975) findings are 
very similar to Beck f s (1973) results. 

First, experimental and control children did not differ 
significantly on I.Q. Second, reading achievement scores were 
always higher (grades 1-4) for experimental children. These 
differences were statistically significant at grades 1 and 2, but 
were not significant at grades 3 and 4. Significant differences 
were not found for boys and girls once analyses of covariance 
were computed with intelligence entered as ctu. covariant. 
Subjects 1 ages did not correlate with their reading scores. 

These five studies addressed broad questions about reading. 
First, Durkin asked if children who can read before first grade 
maintain that advantage over children of equal intelligence. 
Then, McKee, Brzeinski, and Harrison; Beck; and Durkin aoked if 
students could be taught to read in kindergarten if either they 
were randomly assigned for instruction or selected because of 
performance other than intelligence. Taken together, these 
studies provide support for beginning reading instruction in 
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kindergarten, but they shed no light on how childreu develop 
reading comprehension ability. 

Two additional longitudinal studies focus more discretely 
on kindergarten and first grade children's abilities that predict 
later performance in reading. In 1976, Stevenson, Parker, 
Wilkinson, Hegicn, and Fish reported a study of 255 pre- 
kindergarten children that they followed through third grade. 
Stevenson and his colleagues were interested in investigating 
individual differences in cognitive activity associated with 
effective learning of reading and arithmetic in elementary 
school. They undertook this study because they believed that 
better understanding of cognitive ability could lead to preschool 
programs that could enhance students 1 later performance by 
preventing failure in basic skills. Sf.evenson and his colleagues 
developed a battery of measures to administer to children prior 
to kindergarten. These measures included 11 cognitive and 14 
psychometric tasks as well as kindergarten teachers 1 ratings on 
13 additional variables. 

They found that fewer than half the cognitive tasks 
correlated significantly with reading achievement, and that the 
most predictive psychometric tasks dealt with words and letters. 
The children 1 s pre-kindergarten scores on letter naming and the 
visual-auditory version of the paired associates test were the 
best predictors of reading comprehension in second and third 
grade, though verbal recall was also a good predictor in second 
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grade. These pre-kindergarten tasks were consistently better 
predictors than teachers 1 ratings. Similar results have also 
been reported by Dykstra (1967), Barrett (1965), an 1 Durkin 
(1974-1975). 

Lesgold, Resnick, and Hammond (1984) focused their 
longitudinal study on one subskill of reading, rapid word 
recognition. They studied children in a global curriculum, a 
method by which students were expected to recognize and 
understand whole words simultaneously, and a code-emphasis 
curriculum wherein students learned symbol-sound correspondences 
and blending skills intended to facilitate word recognition. The 
theoretical basis for this research is that students have limited 
capacities for processing information. Therefore, a beginning 
reading approach that results in "automaticity" (LaBerge & 
Samuels, 1977) of word recognition will then allow students to 
fo^us attention on comprehending what they read. 

Lesgold and his colleagues designed a study to reflect, "a 
careful plotting of the actual trajectories of reading skill 
development in the primary grades" (p. £) in order to understand 
how word recognition develops and how the development of word 
recognition ability is related to reading comprehension. The 
Lesgold et al. work departed from the studies described earlier 
because it (a) had subjects from two distinct curricula, (b) 
tested students as f:hey reached specific points in their 
curriculum, and (c) measured word reading skills in terms of 
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reaction times for word recognition and classification of word 
meanings. The primary finding from this study was that word 
processing speed and reading comprehension measures showed 
greater predictive paths from early word processing to subsequent 
comprehension than vice versa. Therefore, Lesgold and Resnick 
(1982) concluded that during beginning reading (the first two 
years of instruction) children must develop word processing speed 
in order to comprehend what they read. In addition, the ability 
to comprehend what one reads builds from one year to the next, so 
word processing as an independent skill declines. These findings 
support Chall's (1983) description of the first two stages of 
reading development where students are at first very focused on 
figuring out print and then become unglued from it. Chall (1983) 
labeled the first stage decoding and the second stage, fluency. 

In summary, the major findings from these seven studies 
suggest that (a) children who read early maintain this advantage 
through the middle elementary grades, (b) children can be taught 
to read before first grade, (c) early readers continue to perform 
higher on measures of reading comprehension than children taught 
to read later if they have accelerated reading programs after 
kindergarten, (d) children's abilities to identify letters and 
word configurations prior to kindergarten instruction are better 
predictors of later reading comprehension ability than general 
cognitive or psychometric tasks, and (e) word processing ability 
in early grades results in reading comprehension ability later. 
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Our study builds on these results by measuring students 1 
listening ability and by providing detailed information about the 
role of classroom instructional processes and children's 
experiences with various reading materials in the development of 
reading comprehension ability and the acquisition of 
understanding and concepts in science. 

The fourth and fifth findings from the studies just cited 
greatly influenced the choice of assessment devices for use at 
Time 1, fall of the kindergarten year for entering students. 
Figure 2 shows the four types of ability measured. Letter 
knowledge was measured for both letter names and letter sounds. 
Word reading ability was examined with word endings, word 
families, and a test of reasonably high frequency sight words. 
Language ability was measured with a test of vocabulary, a set of 
analogies, statement repetition items, classification pairs, and 
a measure of the children's statement production ability when 
presented with a series of four pictures and asked to tell a 
story about them. 



Insert Figure 2 about here. 



The final construct of ability measured was students' 
listening comprehension ability, because Humphreys and Davey 
(1983) have found listening comprehension ability to predict 
reading comprehension, performance two years later. 
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Instructional Materials 

Content Covered 

We hypothesize that materials affect management and feedback 
as well as decoding, comprehension, and science instruction 
because materials at least set the boundaries that define the 
content to be covered during instruction. Teachers must work to 
cover the materials. 

Content covered is closely linked to Carroll's (1963) 
concept of opportunity to learn. A variety of measures of 
content covered have been used. These include both measures of 
the quantity of material covered (e.g., the number of books read, 
the number of basals completed, or the number of textbook pages 
covered) and the degree of aiatch or overlap between the material 
covered and the items on the test used to measure student 
achievement. The degree of match has been measured by teacher 
ratings of the proportion of students who have had an opportunity 
to learn the content covered by each item on a test (cf. Husen, 
1967) and by analyses of the overlap between curriculum and 
instructional materials and items on a test (cf. Leinhardt, 
1983). Despite the diversity of the measures used, content 
covered has consistently been found to be positively related to 
student achievement and to student gains in achievement. 

The next section of this paper presents the findings from 
previous research on instructional materials and their effects on 
student achievement. This review is limited to studies that 
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included a systematic analysis of instructional materials before 
explaining student achievement* 

Barr (1973-1974; 1975), Good, Grouws, and Beck^rman (1978), 
Barr, Dreeben, and Wiratchai (1983), and Dreeben (1984) have 
studied the content of social studies curricula, basal reading 
programs, and math series. In all of these studies, significant 
relationships were found between content covered and student 
achievement. These studies support McDonald (1976) who stated, 
"If students have not been taught . . • some . . . content or 
procedure, they simply do not do well on those portions of the 
test relevant to the topic" (p. 27). 

Despite the charge from Cronbach (1975) and Cuba (1978) to 
do more context-sensitive evaluations, few researchers have even 
carefully noted, much less analyzed, the instructional materials 
used in classrooms studied with naturalistic inquiry methods. 

Barr (1973-1974, 1975), Meyer (1982), and Barr, Dreeben, and 
Wiratchai (1983) have carefully analyzed and tiien controlled or 
quantified content covered in order to study the effects of 
either teaching behavior feedback (Meyer, 1982) or the mediating 
effects of a group f s ability on coverage. 

We propose to build upon the work completed on content 
covered by quantifying the vocabulary and concepts of the reading 
and science texts used by our subjects and to derive amounts of 
practice within these materials. We anticipate that simple 
counts of reading vocabulary or scientific domains describe but 
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one aspect of the materials and that particularly for groups of 
lower ability it is important to have repeated practice on 
similar examples in order to promote mastery of a concept. 

Furthermore, we propose to extend previous analyses of 
reading and science materials in order to determine how the 
materials are organized to prepare students to read by building 
or activating background knowledge and then by sequencing 
questions or directive instructions about the text. 

Concepts and text characteristics; Reading and science 
programs . These constructs (depicted in Figure 3) are: concepts 
and skills presented in the basal reading programs including 
letter names, letter sounds, blending, rhyming, whole-word 
reading, and the amount of practice allocated to each concept or 
skill. We will also assess characteristics of the reading and 
science texts. These assessments will include measures of 
vocabulary size, number of domains taught, text length, and text 
characteristics that make them easier or harder for students to 
read. 



Insert Figure 3 about here. 



Independent practice materials . We will further analyze 
independent practice reading materials to determine their phonics 
practice emphasis as well as their text emphasif. Are words 
presented in isolation or do students read connected text? The 
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primary goal of these analyses is to describe quantifiably the 
contents of the instructional materials. 

Comprehension instruction and practice: Reading and 
science . How do these materials build instruction to focus 
students 1 attention on the text? To measure this we will look at 
the questions designed to activate students 1 background 
knowledge; questions answered either explicitly or implicitly in 
the tex';; questions focused on what are often called "story 
grammars" (Brewer & Hay, 1981; Ringler & Weber, 1984); and 
questions directed to other characteristics of narrative prose 
such as the setting, plot, character, theme, and so on. Finally, 
we will count the number of procedural instructions, such as 
"Draw a line from the dog under the porch to the cat," and in 
science, particularly, but not exclusively, the number of 
practical applications of concepts that students do as well as 
instructions for poetry, plays, or other activities. 

Assessment: Re ading and science . Finally, we will count the 
number of review questions to measure how student performance is 
monitored as well as a program's provisions for assessment such 
as end-of-unit, or book tests. 

Instructional Practices 

Management 

Many factors intertwine to form accurate and cohesive 
pictures of how classrooms are managed. Several correlational 
studies (e.g., Stallings & Kaskowitz, 1974; Brophy & Evertson, 
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1976; Fisher, Berliner, Filby, Marliave, Cahen, & Dishaw, 1980), 
experimental work (Anderson, Evertson, & Brophy, 1979; Good, 
Ebmeier, & Beckerman, 1978; Good & Grouws, 1979), as well as 
Barr, Dreeben, and Wiratchai's (1983) results from research on 
grouping practices, instructional materials, and time allocations 
point to the type of managerial decisions and practices teachers 
establish before they even begin to teach. These researchers 
have found consistently positive relationships between these 
characteristics of studsnt achievement. Among these variables 
are: grouping for instruction and consequential pacing of 
students through materials because of the nature of those groups; 
total time allocated for instruction and then the distribution of 
this time to whole-class, small groups, or individuals; and 
students' engagement and success rates. The next portion of this 
paper will briefly describe findings from previous research to 
support these instructional practices. 

Grouping . Seventy-seven percent of all teachers group for 
instruction (Findley & Bryan, 1975), and recent research on 
grouping suggests that grouping practices which were formerly 
most prevalent in the middle and upper grades have filtered down 
to the lower grades (Findley & Bryan, 1975). Despite the 
prevalence of grouping practices, few studies have focused on the 
distribution of students to classes (e.g., grouping decisions 
frequently made by principals with teachers 1 recommendations 
after kindergarten and before beginning first giade) and 
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subsequent intra-classroom grouping by teachers, Borg (1965) 
pointed out that grouping often results in differing 
instructional treatments as teachers adjust their paces to the 
ability of their groups. 

Over half a century ago three studies (Burr, 1931; West, 
1933; Hartill, 1936) demonstrated that substantial variation 
remains in classrooms even after inter-class grouping. Work by 
Dahloff (1971), Barr (1980), Barr, Dreeben, and Wiratchai (1983), 
and most recently, Allington (1984) illustrate the effects of 
grouping on progress through, or coverage of, curricula. This 
link between group formation and coverage is of central interest 
in this study because Barr, Dreeben, and Wiratchai's (1983) 
primary finding is that the mean aptitude of a group powerfully 
influences teachers' instructional pacing, and accounts for 46% 
of the variance in coverage. Allington's work (1984) illustrates 
this point dramatically by documenting that poor readers in 
grades 1, 3, and 5 read roughly half the total words that "good" 
readers in the same grades read. These poor readers averaged 
less than 8% words read silently in first grade, and 50% for 
third and fifth grades when compared to good readers in less than 
a five day period despite similar amounts of oral reading during 
the same period. Thus, there is converging evidence that it is 
important to study grouping because of the indirect effect that 
grouping has on content coverage. To illustrate further the ties 
between instructional materials, grouping, and content coverage, 
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Barr, Dreeben, and Wiratchai (1983) found that the difficulty of 
the instructioral materials exp?ains another 15% of the variance of 
coverage. 

Time and student engagement . Numerous studies have focused 
on time allocated to instruction for literacy. Stallings and 
Kaskowitz (1974) found students in the three highest-performing 
Follow Through models they studied were spending about 50% more 
time on reading activities than students in other models. 
Subsequent studies have demonstrated that the amount of time 
allocated for instruction and the measured engagement rate of 
students during that time may be quite different. In fact, 
Rosenshine (1979) described two teachers using the same 
curriculum. One teacher allocated half an hour to instruction 
while the second teacher allocated twice as much time. But, the 
first teacher exhibited what Brophy (1983) subsequently described 
as "withitness" and maintained an 80% engagement rate while the 
other teacher had only 65% engagement. Rosenshine illustrated 
that a simple comparison of "engaged minutes" in the two 
classrooms during a two and a half month study resulted in 
greater content coverage in the second classroom. Grouping 
practices were not reported in this research, so one cannot 
evaluate the effects of the groups 1 abilities on coverage. 

Results of the Beginning Teacher Evaluation Study (Fisher 
et al., 1978) also demonstrated the importance of considering 
more than content covered or the amount of time allocated to a 
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specific content area. Classes were found to vary, not only in 
the amount of time allocated to an area of study, but in the rate 
at which students were engaged during that time and in rate of 
errors made. Furthermore, students 1 engagement in learning and 
the rate of student errors (or the converse, student success 
rate) were both shown to have strong relationships with student 
gains in achievement. 

As concluded by authors of several recent reviews (e.g., 
Brophy & Good, 1986; Good, 1983; Rosenshine & Stevens, 1984), 
research on classroom instruction has made great progress in the 
past decade. There is converging evidence from a number of 
correlational and experimental studies that gains in student 
achievement are related to three variables that Rosenshine and 
Stevens (1984) have labeled "indices of instructional 
effectiveness." These three indices are content covered, 
academic engaged time, and student success rate. 

It is notable that none of these three indices is an 
instructional variable in the same seme as variables such as 
grouping procedures or feedback. These indices may be more 
appropriately thought of as mediating constructs or even, as 
suggested by Rosenshine and Stevens, as consequences of 
instruction rather than ways of organizing or delivering 
instruction. Nonetheless, content covered, academic engaged 
time, and student success rate have been found to have relatively 
strong relationships with gains in student achievement. We have 
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included measures of: time allocated for reading and science 
instruction; students 1 engagement rate while not directly 
supervised by their teachers; ability of students grouped for 
instruction; teacher-directed instructional time versus 
independent work; teacher-directed time in large group versus 
small-group instruction, the sucefss level of student performance 
on independent work; the rate ac which students progress through 
their curricula; and the teachers 1 allocation of turns to the 
whole class, small groups, and individuals, as well as the 
teachers' frequencies of praise and corrective statements to 
individuals or small groups to measure classroom management. 

Insert Figure 4 about here. 



Instructional F eedback 

Teachers initiate interactions with students. They ask 
instructional questions or give direction. Students either 
respond or remain silent, and their responses are either correct 
or incorrect What happens next? Rosenshine (1979) identified 
feedback to students that is immediate and academically oriented 
as one of the nine characteristics he describes collectively as 
"direct ins true t ion •" 

About the jame time that Rosenshine f s work appeared, Gersten 
(1979) studied the effectiveness of a group of teachers and 
paraprof essionals implex anting a direct instruction model. 
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Gtrsten measured teachers 1 pacing, the rate of teacher/student 
interactions, signals and techniques to keep homogeneous small 
groups responding together, following formats, teachers 1 
adherence to their scripted Jessons and correction procedures, 
and teachers 1 responses to wrong answers. First, Gersten 
documented the teachers that were using these four techniques. 
Next, he correlated the teachers 1 performance on these techniques 
with student achievemer^. He found that teachers who paced 
instruction rapidly, maintained high rates of student accuracy 
and corrected wrong responses produced the highest student gains. 
He also found that of these four techniques, correction 
procedures and high rates of student accuracy (which no doubt 
went hand in hand) were the most "sophisticated" teaching 
behaviors and therefore took longest for teachers to master. 

There is limited empirical support for the positive effects 
of teacher f s feedback to wrong responses. The First Grade 
Reading Group Study (Anderson, Evertson, & Brophy, 1979) provides 
the richest data source during beginning reading instruction. 
First, Anderson, Evertson, and Brophy (1978) completed a 
correlational study with thirty-one teachers. From these data 
they produced an instr w .ional model (Anderson, Evertson, & 
Brophy, 1979) that focused on management of the group as a whole 
(16 principles) and instructional feedback to students 1 answers 
(6 principles). In the experimental study, Anderson et al. 
(1979) described feedback principles. Teachers were to: (a) 
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wait for a child to respond, but indicate a response was expected 
if a child failed to respond after a brief wait; (b) indicate 
when a child was wrong; (c) give the answer if the question was 
factual, provide clues if the answer could be reasoned out, or 
furnish the answer if the child could not produce a correct 
answer after hearing clues; (c) acknowledge correct answers — 
often by repeating good responses; (e) praise moderately; and (f) 
criticize specifically. 

In this experimental study twenty-seven first grade teachers 
received a manual describing the instructional model and limited 
inservice training in its application. Significant effects were 
found for treatment teachers using sustained feedback, though the 
model did not describe or prescribe how teachers were to respond 
to wrong responses. Most sustained feedback led to improved 
answers, and process feedback (responses to students that led 
them through steps to come up with the correct answer) also led 
to higher student performance though teachers seldom used process 
feedback. Treatment teachers also gave more specific praise to 
students, though overall they praised students less than the 
control teachers. Neither group criticized students frequently. 
There were three other interesting differences between these 
treatment and control teachers that complement Gersten's (1979) 
findings. Treatment teachers had higher percentages of correct 
answers (73% correct as compared to 66%), fewer instances of 
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students failing to respond, and fewer reading errors in their 
classes. 

We have empirical support for the effects of teachers' 
instructional feedback to wrong responses from one more study, 
Meyer (1982) found that middle grade poor readers to whoa teachers 
simply told the correct word after word identification errors in 
the first 70 lessons of Corrective Reading (Engelmann, Johnson, 
Becker, Meyer, Carnine, & Becker, 1978) performed as well on 
individually administered criterion-referenced and norm- 
referenced reading measures as comparable groups to whom teachers 
taught complex word analysis corrections. The error rates for 
both groups in Meyer's study were low. In fact, students 
averaged fewer than 3 errors per 100 words of text. Thex-efore, 
the low error rate for both groups might account for lack of 
impact from the more complex word analysis procedures. 

Of Rosenshine's nine characteristics of direct instruction, 
monitoring and feedback are two teaching behaviors that we know 
very little about. In fact, there has been little research on 
feedback reported in the last twenty years, despite a 
comprehensive review of findings related to general feedback 
principles that appeared more than two decades ago (Lumsdaine, 
1963) in the First Handbook of Research on Teaching (N. L. Gage, 
Ed.). Lumsdaine's (1963) review concluded with remarks to 
researchers and teachers about the importance of feedback. In 
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fact, one of his conclusions was that teachers should make overt 
for the learner the process needed to complete a task correctly. 

In light of Lumsdaine f s conclusions an-* the handful of 
studies specifically related to feedback during basic skills 
instruction cited above, we included measures of a number of 
different types of teacher feedback which cluster into three 
categories: feedback after correct responses; feedback after 
incorrect responses; and feedback to written work. The 
measurement model for feedback appears in Figure 5. 



Insert Figure 5 about here. 



After correct responses . When students respond correctly, 
teachers most often either say nothing, repeat the student 
response as if to reconfirm it, or praise with words such as 
"good," or "terrific." 

After incorrect responses . After students have given wrong 
responses, teachers respond in one of three ways. They may 
encourage students by giving them hints or suggestions to "take 
another look," to re-examine their answers. Or, they may ask a 
student to elaborate upon his or her answers. All of these types 
of feedback encourage a student in some way to modify his or her 
answer. 

Just as some types of feedback encourage students, other 
types of feedback terminate a teacher 1 s interaction with 



9 

ERLC 



25 



Heuristic and Measurement Models 

25 

students. For example, a teacher might simply ignore a wrong 
response, give the correct answer, call on another student, or 
negate the first student f s response by saying, for instance, "No , 
the word is not f went. f " This teacher might then direct the 
group to the nexv. word or sentence. 

Regardless of the specific words used, the result of tuese 
instances of feedback is that the teacher goes on to another 
interaction and perhaps even another student. None of these 
forms of feedback continues until students produce a correct 
response. 

Quite different feedback strategies sustain a teacher f s 
interactions with an individual or group of students in order to 
get the correct answer. The simplest thing a teacher might do to 
sustain an interaction is to repeat the question or direction to 
the student who made the mistake. A more elaborate type of 
sustained feedback occurs if a teacher demonstrates the process 
for working through to a correct answer or somehow breaks the 
task down into smaller parts and then puts the parts back 
together. We identify both of these examples of feedback as 
sustained feedback. For example, while reading a sentence a 
student might misidentify the word "went." A teacher who asks, 
"What's the sound of the first letter in that word?" and then 
directs the student to sound out the word, and then asks again 
what the word is has led the student through several steps in 
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order to identify the word correctly and has given sustained 
feedback until he or she got the correct answer. 

With another type of sustained feedback, a teacher might 
give students a rule that applies to the problem they are working 
on to help them come up with the answer* 

Feedback on written work . A final type of feedback is that 
which teachers give to work students complete either on their own 
or after some preparation with the teacher. This is the feedback 
teachers give by grading papers. We collect and analyze student 
work to categorize it as literacy related text/non-text or 
science related* When checking student work we also compare a 
student's true score to the score the teacher gave. 
Decoding, Comprehension, and Science Instruction 

Given the strength of the relationship of content covered, 
academic engaged time, and student success rate with <?ains in 
student achievement, it is important that studies of classroom 
instruction attend to these constructs. However, future advances 
in knowledge about instructional effectiveness will require 
research that goe3 beyond these global constructs. This is so, 
in part, because of the nature of these constructs. They are, as 
was previously indicated, mediators rather than directly 
observable teacher behaviors and relatively little is known about 
teacher behavior that results in increased coverage of content or 
student engagement. Nor is it clear that the ideal student 
success rate is a constant regardless of subject matter, the 
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developmental level of a student, or a student's stage of 
learning. The most effective success rate may be substantially 
different in kindergarten than in grade 5, for example. 

There is, of course, a large body of research relating 
teacher behavior variables to student achievement. Some of this 
research is, at least, suggestive with regard to the types of 
instructional practices that are likely to increase content 
coverage and enhance student engagement. Some of the relevant 
variables (e.g., grouping practices, teacher-directed 
instruction, and use of questions and feedback) have a long 
history. However, more emphasis has been placed on quantity than 
on quality of instruction and to date little attention has been 
paid to the specific instructional context within which the data 
were collected. Furthermore, simple counts of the number of 
questions or of the number of times various types of feedback is 
given provide little information about effective sequencing 
within different contexts. While simple frequencies of 
interactions might be good predictors of student achievement in 
decoding, informed opinion suggests that successful teaching 
characteristics for reading comprehension might be much more 
complicated. Yet leaders in the field of research on teaching 
(e.g., Brophy & Good, 1986; Good, 1983) have strongly emphasized 
the need to give greater attention to quality of instruction and 
to analyses cf instructional sequences. 
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At a global level, research "has shown that effective 
teaching is characterized by a predictable sequence of 
demonstration, guided practice, feedback and corrections, and 
independent practice" (Rosenshine & Stevens, 1984, p. 788), 
Within this general sequence, Rosenshine and Stevens have also 
abstracted a description of behaviors in each stage of 
instruction that research has suggested lead to more effective 
instruction. Their conclusions regarding effective behaviors are 
summarized in Table 1. 

The summary in Table 1 provides a rich context for 
organizing and analyzing classroom observation variables. It 
also provides a framework for the development of qualitative 
indicators of classroom instruction and for planning sequential 
analyses. 



Insert Table 1 about here. 



We therefore hypothesize that during decoding, 
comprehension, and science instruction effective teachers will 
generally follow these stages of demonstration, guided practice, 
feedback/ corrections, and independent practice, and that the 
sequence and frequency of interactions will vary dependent upon 
the type of skill the teacher is working on and the stage of 
instruction for the group. Long chains of letter sound practice 
interrupted only by feedback that result in a high success rate 
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of student performance may yield high student achievement for 
letter-sound knowledge, for example. But, effective sequences 
during reading comprehension instruction might begin with 
questions to build or activate background knowledge and then move 
to a series of text explicit or implicit questions to check 
students 1 understanding of information in the text. Effective 
sequences might conclude with summaries or other kinds of 
interactions to demonstrate knowledge of what Brown and Day 
(1983) refer to as the "gist." The measurement models for 
decoding, comprehension, and science instruction appear 
respectively in Figures 6 and 7. 



Insert Figures 6 and 7 about here. 

Home Support for Literacy and Science Knowledge 
What do parents do to support literacy and science knowledge 
in their children? There are three general lines of research 
that address this question. This research is on familial 
influences of cognitive development and student achievement as 
well as results found from studying two quite different samples 
of parents: parents of students in compensatory education 
programs and parents of students who were reading before they 
started school. 

Carter (1983) reported data from interviews with about 
15,000 parents in order to describe the "typical" home 
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environment of elementary school-age children. He found that the 
average elementary school child comes from a two-adult family 
with parents around age 35. These parents are white and live in 
a single family home. They are \iigh school graduates. These 
parents report that elementary school age children play for about 
two hours each day, watch television for another two hours, and 
also spend another hour each on chores, reading for pleasure, 
and studying. Parents are generally involved in school 
activities and rate their children's schools as "excellent." 

Carter correlated these general characteristics of home 
environment to student achievement and found low to moderate 
negative correlations for family size, ethnicity, and the ratio 
of occupants to dwelling rooms. He found low to moderate 
positive correlations for two-adult families and head of 
household's level of education. Next, we'll report global 
findings from the rich tradition of research on more specific 
family influences on student achievement. 

Support for the family's influence on general cognitive 
development and student achievement is generally attributed to 
four areas: biological factors; environmental factors; status 
variables; and family processes. Most simply put, researchers 
generally agree that biological and environmental factors 
interact to influence intelligence. Considerable disagreement 
rages, however, about the magnitude of the effect of each of 
these variables. Scarr and Weinberg (1978) studied adopted 
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children and their biological and adoptive parents and concluded 
that 40-70% of the variance in an individual's IQ score is 
explained by genetic factors* Studies involving parental 
interviews and observational studies of parents and their 
children (Hay & O'Brien, 1983; Wilson, 1983) have resulted in 
defining terms such as the intellectual climate* 

Environmental variables iound to be related to cognitive 
development and school achievement include moderate stimulation 
(Wachs & Gruen, 1982), personal space (Wachs, 1979), and high 
rates of older siblings or adults (Zajonc, 1976, 1983), with 
demonstrated lower performance for students from single-parent 
homes (Herzog & Sudia, 1973), though more recent work 
(Hetherington, Camara, & Featherman, 1981; Shinn, 1978) suggests 
less clear evidence that children from single-parent homes have 
lower cognitive ability or school achievement* Teacher bias 
against children from single-parent homes has been found in at 
least one study (Santrock & Tracy, 1978)* The effects of 
maternal employment appear to be positive for children from low 
socioeconomic status families (Rieber & Womach, 1967) and 
inconclusive for middle and working class children (Gold & 
Andres, 1978)* 

Socioeconomic status by itself has not been found to explain 
variance in student achievement (Henderson, 1981), although a 
number of researchers argue that processes in these families, but 
not their socioeconomic stat *s alone, accounts for lower student 
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achievement* A number of other studies have focused on mothers 1 
instructional strategies (Hess & Shipman, 1965) and several 
intervention programs (e.g., Gordon, 1977; Weikart & Lambie, 
1968) grew from this work in attempts to teach low-income mothers 
instructional strategies to use with their children. Although 
many researchers (e.g., Scott-Jones, 1984) acknowledge the 
continuing roles of parents as teachers, others (Scribner & Cole, 
1973; Henderson, 1981) suggest that parents from different 
socioeconomic groups focus on different domains and that the 
domains of poor parents less closely match school curricula than 
the choices of more affluent parents. Thus, these choices may 
result in differential student achievement. These constructs 
appear in Figure 8. 



Insert Figure 8 about here. 



Home support for literacy was of central interest in 
Durkin's work (1966) on children who read early. In this study 
Durkin identified children already reading when they started 
school. She then interviewed parents to find out what these 
families had done that might have produced these early readers. 
Durkin's subject?' parents identified 28 qualities in their 
children with persistence, perfectioni^tic, high-strung, good 
disposition, and serious the most frequently mentioned 
descriptors. Forty-two of Durkin's 49 subjects reported that a 
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parent (almost always the mother) had taught them to read. 
Descriptions of the early readers 1 home reading instruction 
varied from being told words (31%) to being taught how to sound 
out words (64%). A few children declared they taught themselves. 

Parents of early readers also reported doing a variety of 
activities that are indirectly related to reading. Among these 
activities were: reading to children, buying books, helping child 
learn to print, helping older children with school work as the 
younger child watched, buying readers and school-like workbooks. 
In addition, Durkin's early readers reported they were motivated 
to learn to read primarily by four things: being read to at 
home; wanting to keep up with older siblings; having reading 
materials; and having blackboards available at home. Many early 
readers first became interested in writing and spelling and then 
in reading. 

How might these characteristics also relate to tr oung 
children f s knowledge of science? The relationship between home 
instruction and science learning has been studied far less 
rigorously than home support for literacy, so the answer is much 
more tentative. Steinkamp and Maehr (1983) studied 255 
correlations reported in sixty-six articles and concluded that 
girls 1 and boys 1 science achievement is positively related to 
affect, though weakly. Cognitive ability, on the other hand, 
correlated much more strongly with science achievement: with 
boys achieving slightly higher than girls, particularly in areas 
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of science generally thought of as "more masculine" (Walberg, 
1967) (physics or engineering, for example), Weitzman and Rizzo 
(1974) concluded that little boys have been found to engage more 
actively in taking machines and other things apart whereas girls 
self-select other kinds of play. But, we can find no research 
that identifies what parents do that directly or indirectly 
results in these differences. Out of school experience is 
hypothesized to explain a great deal of variance in student 
achievement in science by fourth or fifth grade because there is 
mounting evidence that students receive little formal or informal 
science instruction in school (Kelly, 1978). 

Whenever researchers find substantial differences in student 
achievement that cannot be explained either because they exist, 
when students begin school (as with Durkin's 1966 study of ea) ' 
readers) or as in science where there is little instruction in 
school, it becomes increasingly essential to attempt co measure 
and track systematically what subjects are doing o it of school. 
Although students spend over 15,000 hours in school from 
kindergarten through high school, that is less than 2% of their 
total lives. What are they doing the rest of the time? 

We hypothesize that it is imperative to measure at least 
four aspects of young students' lives to gain insight on why and 
how they have different achievements in science. First, we argue 
that both directly and indirectly parents leach their children to 
calibrate and observe the world around them. Second, parents 



ERLC 



35 



Heuristic and Measurement Models 

35 

provide and encourage experiences with and for their children 
that provide exposure to subjects that children may later pursue 
on their own. Third, parents control resources, especially books 
and experiences particularly for young children that may 
stimulate interest in science while informally building students 1 
background knowledge about several scientific domains. Finally, 
students themselves by at least age 5 begin to choose activities 
to pursue when given opportunities that may predict later 
achievement in science. These constructs are illustrated in 
Figure 9. 

Insert Figure 9 about here. 



Student Ability, Time Z 
What types of student ability at the and of kindergarten 
will predict later student achievement in reading comprehension 
and science, and how was student performance at the end of the 
year mediated by what went on in those students 1 homes and 
classrooms? The remainder of this paper will be limited to a 
short description of measuring student ability at time 2, the end 
of kindergarten. Measurement at Time 2 was expanded from the 
four constructs measured at Time 1 (Letter Knowledge, Word 
Reading Ability, Oral Language Ability, and Listening 
Comprehension Ability) to include a measure of reading 
comprehension, a measure of metacognition (for particularly 
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high-performing students as identified by their reading 
comprehension scores), and a measure of general science 
knowledge. Measurement of Letter Knowledge, Word Identification, 
and Word Reading Ability as well as the measure of Listening 
Comprehension Ability was either the same instrument used for 
fwill testing or the next level of the same instrument. 

The measures of Reading Comprehension Ability and Science 
Knowledge were added in order to provide data on these emerging 
and relevant areas of student achievement. The measurement model 
for student ability, Time 2, appears as Figure 10. 



Insert Figure 10 about here. 



In summary, our goal was first to develop a heuristic model 
to represent the major variables believed to be integral to 
student development of reading comprehension ability and science 
knowledge. This paper has attempted to present the empirical 
support for both the heuristic and measurement models driving ou: 
research. We expect to refine these models during the remaining 
five and a half years of this study. 
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Table 1 

Effective Behaviors in Four Stages of Instruction 
(Based on Rosenshine & Stevens, 1984) 



Stage 




P"f f opf^ \TO Tl £» Vl QTT "f at*o 
JCiJ. IcCLlvc OctloVlUio 


Demonstration 


1. 


ftm^ll ofpno 

OIIIOXX OLCpO 




2. 


many cACUttpico 




3. 


interspersed questions to 






check student understanding 


Guided Practice 


1. 


frequent questions 




2. 


direct focus on materials 




3. 


COn t* "f nnpH nnt*"f1 a Vi"f crVi 






student fliirrpflfl Tat*<a ■{ o 






ac n*f pupH 
aviixcvcu 


Feedback/Corrections 


1. 


Ht"(p£ fk f f i Tmat"i An nf o 

UJL XCJL oi X 11 1UO LI vll \Ji. CI 






correct response 




2. 


hints, simpler questions, 






or explanation following 






an incorrect response 


Independent Practice 


1. 


active monitoring 




2. 


sufficient for 






overlearning and rapid 






responding 
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Figure 1 
HEURISTIC MODEL 



Instructional Materials 
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Instructional 
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Instruction and Practice 
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Figure 2 
Student Ability Time 1 



Letter Knowledge 

a. names 

b. sc*w*\ds 

Word Reading Ability- 

a. endings 

b. word families 

c. random word lists 



Oral Language Ability 

a. vccabulary 

b. analogies 

c. statement repetition 

d. classification 

e. prompted utterances 

Listening Comprehension Ability 

a. comprehension 

b. interpretation 




Student 
Ability 
Time 1 



Figure 3 
Measurement Model for Materials 



Concepts: Basal Reading Prograi 
a* letter names 

b. letter sounds 

c. blending 

d. rhyming 

e. whole word reading 

Text Characteristics 

a. vocabulary size 

b. domains taught 

c. text length 
a. text consideratene 

Independent Practice Materials 

a. phonics emphasis 

b. text emphasis 

(1) words in isolation 

(2) connected text 



Comprehension Instruction and Practice: 

a. background knowledge building 

b. text-explicit questions 

c. text-implicit questions 

d. story grammar referents 

e. procedural instructions 

f. practical applications 




Materials' 
Characteristics 




Reading and Science 



Assessment: Reading and Science 

a. frequency 

b. ties to phonics instruction 

c. ties to comprehension instruction 

d. ties to vocabulary development 

e. ties to activities 
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Figure 4 

Measurement Model for Classroom Management 



time allocated 
for reading 
instruction 



teacher-direct ei 
time small group 
vs. large group 
instruction 



independent work tin* 



engagement rate, 
independent work 



CLASSROOM 
MANAGEMENT 



aptitude of students 

grouped for instruction 



success level on 
independent work 



rate at which students 
progress through curricula 



percent students 
called on 



praise and corrective 
statements to groups 
and individuals 
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Figure 5 
Measurement Model for Feedback 



Encourages 



a. 
b. 
c. 



hint 
re-examine 
elaborate 




Terminates 

a. ignores 

b. calls on another 

c. negates 

d. gives answer 



Sustains strategic 
corrective procedure 

a. models 

b. leads 

c. extends 

d. repeats question 

e. gives rule 




INSTRUCTIONAL 
FEEDBACK 



Scores 

a. workbooks 

b. boardwork 

c. other independent work 
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Figure 6 

Measurement Model for Decoding Practice 




a. rate emphasis 

b. accuracy emphasis 
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Figure 7 

Measurement Model for Comprehending 
Narrative and Expository Text 



Elicits Background Knowledg 



Focus on Text: 

a. explicit information 

b. implicit information 

c. vocabulary 




COMPREHENSION 
INSTRUCTION 



Text Unit Change: 

a. word level 

b. sentence lev<jl 

c. paragraph level 

d. story /information 
unit level 
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Figure 8 

Home Background Stable Variables 



Biological Factors 




HOME BACKGROUND 
STABLE VARIABLES 



a. employed adults 

b. personal space 
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Figure 9 

Home Support for Literacy and Science 



Instruction from parents in: 

a. decoding 

b. observational processes 

c. measurement 



Experience provided in: 

a. library 

b. natural sciences 

c. historical or other museums, et 



Books and other reading materials on: 

a. natural sciences 

b. biological sciences 

c. physical sciences 

d. general references 




HOME SUPPORT 
FOR LITERACY 
AND SCIENCE 



Opportunities for children to experiment with: 

a. concrete objects 

b. raw materials 
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Figure 10 
Student Ability Time 2 



Letter Knowledge' 

a. names 

b. sounds 



Word Identification Ability 

a. beginning consonant clue^ 

b. random words 



Word Reading Ability^ 

a. endings 

b. word families 

c. random word lists 



Reading Comprehension Ability. 

a. word comprehension 

b . sentence comprehension 

c. paragraph comprehension 

d. metacognition (for high 
performing comprehenders) 



STUDENT 
ABILITY 
TIME 2 



Listening Comprehension Ability 

a. comprehension 

b . interpretation 
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General Science Knowledge' 

a. concepts 

b. vocabulary 
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